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Abstract 

The modified elliptic genus for an M5-brane wrapped on a four-cycle of a Calabi-Yau 
threefold encodes the degeneracies of an infinite set of BPS states in four dimensions. By 
holomorphy and modular invariance, it can be determined completely from the knowledge 
of a finite set of such BPS states. We show the feasibility of such a computation and 
determine the exact modified elliptic genus for an M5-brane wrapping a hyperplane section 
of the quintic threefold. 
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1. Introduction 

An exact counting of BPS states in M = 2, d = 4 compactifications of (say type IIA) 
string theory is a difficult problem. For large charges these objects have dual descriptions as 
supersymmetric black holes. The leading and subleading order entropies of such black holes 
in M-theory has been explained using the (0, 4) CFT on the effective string coming from 
a wrapped M5-brane Jl[. Herein we refine the analysis of jl] and consider the modified 
elliptic genus (to be defined later) which counts BPS states of D4-D2-D0 system on a 
generic Calabi-Yau threefold. As emphasized in , modular invariance imposes 

strong constraints on the elliptic genus, and determines it completely in terms of a finite 
number of coefficients in its (/-expansion. In this paper we will use this fact to derive the 
exact partition function of a basic class of BPS states in type IIA string compactified on 
the quintic threefold. Our results shed light on the conjectured relation |]6|-|T7[1 between the 
exact partition function of the black hole and the topological string amplitude. 

An alternative approach - related by M/IIA duality - to count the degeneracy of D4- 
D2-D0 bound states is to quantize the classical moduli space of supersymmetric D-brane 
configurations. The latter involve wrapped D4-brane with fluxes bound to pointlike in- 
stantons. The possible U(l) fluxes on the D4-brane are in 1-1 correspondence with divisors 
(an algebraic sum of holomorphic curves) on its world volume, and in particular involves 
nontrivial information of Gromov-Witten invariants. We use this method to compute the 
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coefficients of the modified elliptic genus in the example of the quintic for small charges cor- 
responding to the first few terms in the g-expansion. A priori, one might expect the results 
to overdetermine the elliptic genus: in principle, a few of these numbers are sufficient to 
determine the elliptic genus, and all other coefficients are predicted based on the modular 
property. This would give a sharp test of the direct counting of supersymmetric D4-D2-D0 
bound states. In the simple example we consider, the system of minimal D4-brane on the 
quintic, this agreement requires highly nontrivial relations among Gromov-Witten invari- 
ants of various degrees. Miraculously, we find this relation to hold in all the coefficients we 
computed based on the geometry of the classical moduli space, up to a small ambiguity 
due to singularities in the moduli space, corresponding to colliding pointlike DO instantons. 

We propose an approach to resolve this ambiguity, based on the relevant dual M- 
theory AdSs xS 2 x CY attractor geometry [TB\. In this picture the needed coefficients of 
the g-expansion are supplied by the degeneracies of a few low-lying BPS states of gravitons 
and wrapped (anti-)M2-branes. It is not clear to us why this dual picture should be valid, 
since some of the charges are small in all of our our examples. Nevertheless, with this 
approach, we find perfect agreement of the degeneracy of BPS states with the relations 
expected from the modular property of the elliptic genus. (This in turns suggests that 
there should be some justification for our approach.) 

This approach sheds light on the conjecture that the Gromov-Witten invariants are 
captured by the black hole partition function. Here we see that the U(l) fluxes on the D4- 
brane, which are related to curves in the CY subject to the constraint that it must lie on the 
world volume of the D4-brane, carry information about Gromov-Witten invariants. This 
extra constraint becomes unimportant for large D4-brane charges (a sufficiently high degree 
hypersurface can be made to pass through any given collection of curves), in which limit 
the (square of the) topological string partition function becomes a good approximation of 
the black hole partition function. 

In section 2, we describe the general structure of the modified elliptic genus of the 
MSW (0, 4) CFT. We argue that the elliptic genus has simple anti-holomorphic dependence, 
and can be determined by a finite number of holomorphic characters that transform in a 
known representation of £X(2, Z). In section 3, we study the (0,4) CFT for an M5-brane 
wrapped on the hyperplane section in the quintic. We count the degeneracy of a number 
of BPS states based on the classical moduli space of D-brane configurations, as well as a 
hypothetical chiral ring structure motivated by a dilute gas approximation in the AdS^ 
dual. These results are compared to the modular property of the elliptic genus, and 
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surprising agreements are found. In particular, we conjecture an exact expression for the 
elliptic genus in this case. Section 4 studies a different example, a free Z 5 quotient of the 
Fermat quintic. In this case we present the structure of the elliptic genus as determined 
by its modular property, although the direct counting based on the classical moduli space 
is more difficult than the quintic, and is left to future work. We conclude in section 5. 

Results related to those of section 2 on the structure of the modified elliptic genus 
have been independently obtained by Denef and Moore || , and de Boer, Cheng, Dijkgraaf, 
Manschot and E. Verlinde [Q. 

2. The M5-brane (0,4) CFT 

We will be considering an M-theory 5-brane wrapped on a 4-cycle P in Calabi-Yau 
space X, and extended in R ' . The low energy excitations of the M5-brane can be 
described by an effective 1 + 1 dimensional CFT 0, which has (0,4) superconformal 
symmetry. If one further compactifies the direction in which the M5-brane extends in 
R > on a circle, one obtains a wrapped D4-brane in type IIA string theory compactified 
on X. Excitations of the M5-brane induce M2-brane charges and can carry momenta. 
These in general correspond to D4-D2-D0 bound states in type IIA string theory. The 
correspondence between M5-brane states and D4-D2-D0 bound states is understood and 
will be used freely in this paper. 

In the following, we will follow the convention of [jl|] and denote by QDabc the inter- 
section numbers in a basis Y*a of H^X, Z). The D4, D2, DO charges will often be labelled 
p , qA, qo, respectively. Dab = DabcP C > D = DabcP A P B P C and D AB is the inverse 
matrix of Dab- The attractor Kahler class of X is proportional to J = p A u>A where to a is 
a basis of harmonic (1, 1) forms dual to Ha- 

2.1. General structure 

The M5-brane (0, 4) CFT [TJ has central charge c L = 6D + c 2 ■ P, c R = 6D + ±c 2 • P. 
There are 3 noncompact bosons X % on the left and right, corresponding to the collective 
coordinates in the transverse R 3 . There are free bosons 4>a, coming from the world volume 
anti-symmetric tensor field reduced on loa- Namely 

T ~ D AB d<p A AujB (2.1) 
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The self-duality of T implies that ip = p <f>A is purely right moving. Together with 
four goldstinos , i/> ±± , corresponding to the four supersymmetries broken by the M5-brane, 
(dX l , d(p, V' ±± ) form a right moving Af = 4 multiplet. The 4>a's are compactified on a 
lattice of signature — 1, 1), with the intersection pairing given by —^D AB , where 

the (h 1 ' 1 — 1) bosons orthogonal to <p are left movers. 

This CFT in fact has ^4fc+,oo symmetry algebra (k + = ^p), which is a Wigner con- 
traction of the large M = 4 superconformal algebra. Writing U = dtp, in addition to the 
small M = 4 SCA relations, there are OPEs 

G aa (z)^\0) ~ g^gg) (2.2) 

(a l )%^ a (0) 
J l R (z)i/j aa (0) ~ i-g 

We will restrict to the case where X is a Calabi-Yau manifold of full SU(3) holonomy. 
Let A = H 2 (P, Z) be the cohomology lattice of P. In general P may not be a spin manifold, 
and A, which is self-dual, may not be even. In this case there is Freed- Witten anomaly 
|18|| , which requires one to turn on a half-integral flux |ci(P) in addition to integral fluxes 
on the M5-brane world volume. We will write J = p A u)A to represent the class of P itself, 
or the cohomology class dual to P H P in flgfP), which is the same as —C\{P). One can 
write a modular invariant theta function associated with the lattice A, 

Q A (r r y) = ^_^p-Q( v ) e -' KiTV -- ni ~ v ++ 2ni <i( v )-y (2 3) 

Here v+ and w_ are the self-dual and anti-self-dual projections of lattice vector v, or 
equivalently, projections along J and J -1 . v± are defined using the intersection form on A. 
q(v) is the natural projection of v from H^P, Z) to ^(A, Z), corresponding to the M2/D2- 
brane charge. Note that J is an characteristic element of H 2 (P, Z), hence v 2 + 5(f) - p = 
mod 2, (— )P'9( U ) = 1 when A is even. 

Ax = H 2 (X, Z) is embedded in A as a sublattice. It consists of charge vectors with 
qA = 6DABk B , k A E Z. A x C A consists of only left- moving lattice vectors. The theta 
function (|2.3|) can be decomposed as 

A (r, T,y) = J2 ©A^+5(^)6>Ax+5(r, r, y) (2.4) 
5 
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where 5 runs through a finite set of det(6DAB) shift vectors. The functions 0\ x+ s, which 
we will abbreviate as 0,5, can be written explicitly 



e s (r,r,y)= £ (-)^exp 

q A =6D AB (k B + ±p B )+5 A , k A EZ 



2mT ( p A p B AB \ 

- D ) q A q B 



12 V D 

2niT 



12D 



(p A Qa) 2 + 2ixiy A q A 



(2.5) 



2.2. The modified elliptic genus 



We are interested in computing a supersymmetric index of the (0, 4) CFT. The elliptic 
genus vanishes, due to the degeneracy of Ramond ground state generated by the zero modes 
of the goldstinos tp^- As explained in the previous subsection, the CFT has symmetry 
algebra Ak+ oo, which extends the small M = 4 superconformal algebra. One can define a 



modified elliptic genus IS 



Z{r,T,y) =Tv R ^F 2 (-) F q Lo -^q L °-^e 2niyAQA (2.6) 

where q = e 27 " T , Q A are the charges associated with the free bosons <fi A , corresponding 
to induced M2-brane charges on the M5-brane. F is a fermion number, which can be 
identified with 2J\ + p a Qa-, where Jr is the right moving R-charge, and p a Qa is the 
contribution from the quantization of the self-dual 3-form field (this is an example of a 
general phenomenon explained in 0). 

An important point is that not only the right moving ground states contribute to 
Z. Let |0) be a ground state, then acting on |0) generates a multiplet of 4 states, 
contributing 1 to Tr^-(— ) F . These states are annihilated by the supercharges G . Now 
consider a state of charge qA under the current ja = dcpA, say \q) = e lD qA< ^ B \0). G 
acting on p A <pA gives rise to its fermionic partners and leave the left moving fields 

invariant. Hence 

(G^ -p A Q A ^ ± )\q) = (2.7) 

This is simply saying that the state \q) preserves supersymmetries nonlinearly, and acting 
with Gq doesn't give rise to new states other than the multiplet generated by 'Pq' ± ■ This 
is in accord with the fact that qA correspond to induced D2-brane charges, and D4-D2 
bound states preserve different sets of supersymmetries than that of D4(-D0). Therefore 
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this multiplet also contributes 1 to the modified elliptic genus. In general the modified 
elliptic genus Z receives contribution from states of charge q A with 

do - f 4 M) = ( ^§fw (2-8) 
As in |||5|,|J, the modified elliptic genus has the general form 

Z(r, r,y) = J2 Z S (t)0 S (t, t, y) (2.9) 

where 0^ are given by ( |2.5| ). This structure can be argued using the fact that shifting 
.B-field by an integral amount on X does not change the degeneracy of D4-D2-D0 bound 
states, but generates additional D2 and DO-brane charges, corresponding to a translation 
in Ax- Another way to think about (|2.9|) is that the theta function of the co ho mo logy 
lattice vectors of H 2 (P, Z) that do not correspond to conserved charges get completed into 
holomorphic characters Zs(r) in the full CFT. 

&s(t, r, y) form a modular representation in terms of weight (^(h 1 ' 1 ^) — 1), |) Jacobi 
forms. The T transformation is represented by the matrix 

Tg = S 5X exp {-^D AB 5 A 5 B ^j (2.10) 

The S transformation is represented by 

Sf x = -^=e,p^D AB 5 A X B ^ (2.11) 

The modified elliptic genus of the MSW (0, 4) CFT is expected to be a weight (— §, |) 
Jacobi form. The left weight — | comes from the three noncompact bosons, and the right 
weight is modified by the insertion of F 2 to — | + 2 = |. Zs(r) transform under SL(2, Z) 
with T = (T )*, S = (S )* up to an overall phase that is easy to determine. 

Knowing the modular representation of Zg(r), one can determine all of them from the 
polar terms in the g-expansion of Zg, where q = e 27riT , via the generalized Rademacher 
expansion. Equivalently, there is a basis of modular vectors transforming the same way as 
Zs(t) with the most singular polar term q~^4 ; whose number is the same as the number 
of possible polar terms of Z§(r). We will explore the constraints of modular invariance of 
Z on the degeneracy of BPS states in the rest of this paper. 
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3. BPS states on the quintic 

In this section X will be the quintic 3-fold with a generic complex structure. We will 
study the (0, 4) CFT associated with an M5-brane wrapped on the hyperplane section P 
in X. J will refer to the hyperplane class. This CFT has cl = 55, cr = 30, and D = |. 

3.1. A naive counting from geometry 

Our strategy will be to count the D4-D2-D0 bound states of given charges (p = 
l,5i,9o) by computing the Euler character of the classical moduli space of the branes. 
The D4-brane is wrapped on the hyperplane section P, and it is free to move in its moduli 
space P 4 . In a supersymmetric configuration, the D2-branes are dissolved into fluxes on the 
D4 world volume. We will assume that DO-branes can be either pointlike instantons (which 
can form bound states among themselves) on the D4-brane world volume, or dissolve into 
smooth £7(1) fluxes. 

One may attempt to describe the moduli space of classically supersymmetric D4- 
D2-D0 configuration as a fibration over the D4 moduli space, the fiber being the Hilbert 
scheme of points on the D4-brane world volume etc. This is a useful approximation in the 
limit of large DO-brane charges, but is difficult to apply for small charges. The reason is 
that the D4-brane world volume degenerates in various loci in its moduli space. It turns 
out that for the cases we will be computing, it is more useful to describe the moduli space 
by first fixing the DO-branes, and consider the space of D4-branes that pass through these 
DO-branes and admit certain classes of fluxes. 

Due to Freed- Witten anomaly one must turn on half integral flux, say F = \ J, on 
the D4-brane. We will call this the "pure" D4-brane. There is induced D2-brane charge | 
and DO-brane charge pU| , pn 



X(P) 1 f „ „ 35 
F A F = 



24 2 /p 12 



/A \ 1 

In the CFT this corresponds to a state with L = and (L — §f) = X 2D = §• ^ n 
the following we will label states by their additional D2-brane charge Aq±, as well as the 
additional DO-brane charge Ago-^ 

• A gi = 0, Aq = (L = 0) 



Ago is related to L and L by Aq - f| = (L - |r) - (L - ff) = ( L o ~ §) ~ jni^Qi + %f '■ 
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This is the "pure" D4-brane, which is free to move around its moduli space P 4 . The 
number of supersymmetric states is x(P 4 ) = 5. 

• A gi = 0, Aq Q = 1(L = 1) 

Next we consider the D4 bound to a single DO-brane. Requiring the D4-brane to pass 
through the DO, the moduli space of D4-D0 is P 3 fibered over X. It has Euler character 
X (P 3 )X(X) = -800. 

• A qi = 0, Aq = 2 (L = 2) 

Let us consider the D4 bound to 2 DO's. The two DO-branes can either both be free 
to move on the D4-brane world volume, or bind together as a single pointlike object. The 
latter is counted the same way as the Ago = 1 case, whereas the former is described by the 
moduli space as P fibered over Syni (X). We shall ignore the subtle contribution from 
the locus in the moduli space where the two DO's coincide. The number of states, counted 
with sign, is then x(P 2 )x(Sym 2 (X)) + x(P 3 )xP0 = 58900. 

• A Ql = 0, Ago = 3 (L = 3) 

The states with Ago = 3 involves the D4 bound to 3 pointlike instantons, as well as 
a D4-brane with flux F = G\ — C[, where C\ and C[ are two different degree 1 rational 
curves in X that lie in P, we write them for their dual harmonic forms on P. The latter 
can happen only when P passes through both C\ and C[. C\ and C[ generically do not 
touch, and each have self-intersection number C\ ■ C\ = — 3.11 The flux F gives rise to 
induced DO-brane charge — \F 2 = 3. Generically this condition fixes a unique hyperplane, 
and we have 2875 x 2874 choices of C\ — C[. These give rise to (again, ignoring the subtlety 
where the DO's coincide in the moduli space) 

X^MSym 3 ^)) + X (P 2 M*) 2 + X(P 3 )XP0 + 2875 • 2874 = 5755150 

states. 

• Aq x = l,A 9o = 1 (L = f) 

Next we consider the D4 bound to a single D2-brane. This can be realized by turning 
on a flux F = C\ on the D4-brane world volume (in addition to the original -jj), where 
C\ is (dual to) a degree 1 rational curve. It gives rise to additional induced DO-brane 

2 This follows from the adjunction formula, for a curve C in P, C ■ C + C ■ J = 2g — 2. 
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charge — |(F + -|) 2 + | = 1. Requiring the D4-brane to pass through the curve G\ 
reduces its moduli space from P 4 to P 2 . There are 2875 degree 1 rational curves C\. Our 
naive quantization of the classical moduli space doesn not determine the overall fermion 
number of these states. However, we can fix the fermion number by comparison with 
the holographic dual, and these states turn out to have an odd fermion number.i This 
description will be explored in the next section. In the end, we get the counting x(P 2 ) • 
(-2875) = -8625. 

Similarly, the same degeneracy applies to the states with Aq\ = — 1, Aqo = 2 (Lo = | ). 

• Agi = l,Ag = 2 (L = f ) 

Such states involve a D4 with flux F = C\ where C\ is a degree 1 rational curve, 
as well as a pointlike DO instanton. We don't understand precisely what happens when 
the DO-brane coincides with C±, and will again ignore this subtlety for now. When the 
DO-brane is away from C±, the D4-brane that passes through both the DO-brane and the 
curve C\ has moduli space P 1 . The number of states counted with sign is 

(-2875) ■ x(X)x(P 1 ) = 1150000. 

• A gi = 2, A ?0 = 1 (L = f ) 

The states with D2-brane charge Aqi = 2 has a minimal DO-brane charge 1, coming 
from the D4-brane with flux F = C2, where C2 is a degree 2 rational curve. There are 
609250 such curves. Hyperplanes that pass though a degree 2 curve have moduli space P 1 . 
We have degeneracy! (-609250) • x(P X ) = -1218500. 

• A Ql = 2, Aq Q = 2 (L = %) 

The counting of such states receives three kinds of contributions: a D4 with flux 
F = C\ + C[ where C\ , C[ are degree 1 rational curves; D4 with flux F = C2 where C2 is 
a degree 2 rational curve, bound to a DO pointlike instanton; and D4 with flux F = J — C3 

3 A D4-brane with flux F = C\ corresponds to an M2-brane wrapped on C\ C X in the dual 
AdSz x S 2 x X geometry. The chiral primary state associated with this wrapped M2-brane is a 
fermion. 

4 The sign, once again, is determined by comparison to the AdS^ dual. 
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where C3 is a degree 3 rational curve. The counting is (again, ignoring the subtle case 
when the DO coincides with C<i) 

\ 2875 • 2874 + 2875 • x(P 2 ) + (-609250) • x{X) + 317206375 = 443196375. 

One might think that there is another contribution, coming from D4 with flux F = J — C 3 
bound to a single DO, where C 3 is a degree 3 genus 1 curve. These however give rise to 
the same set of fluxes as F = C^.i 

3.2. Connection to topological strings 

The M5-brane (0, 4) CFT is dual to M-theory on A0IS3 x S 2 x X attractor geometry 
2^,|16[ . It was shown in |1(| that the elliptic genus that counts the chiral primaries coming 



from supergravity modes as well as CY-wrapped M2 and anti-M2 branes in the dilute 
gas approximation reproduces the square of the topological string partition function on 
X. The supergravity picture is not expected to be generally valid for small M5-brane 
charges/fluxes, although some quantities may be BPS protected. However there appears 
to be a rough correspondence between supersymmetric ground states of the D4-brane 
bound to D2, DO-branes and multi-particle chiral primaries in A0IS3: 

pointlike DO instantons « — > massless supergravity modes 
flux F = c i ~ Yl C j i — " M2 wra PP ed on c * M2~ wrapped on Cj 

i 3 

where Ci , Cj are holomorphic curves in X . 

Under the spectral flow of 00 algebra from NS to Ramond sector, which includes 
L — > L — </fl + ff and a shift of the membrane charges Qa — * Qa + 3DabP B (see also 0), 
the chiral primaries flow to Ramond sector states of the form (|2.7|), (|2.8|). The unitarity 



5 To see whether F\ = C2 and F2 = J — C 3 are the same flux on P, one simply needs to check 
whether (F^ — F^) 2 = 0, where F~ is the anti-self-dual projection of F, F~ = F — ~(F ■ J)J . This 
is the case if and only if C2 • C 3 = 6. In fact, any C' 3 can be defined by the equations of the form 
P-z{x l ) = 0,Hi(x l ) = G\(x l ) = 0, where P3 is a cubic polynomial in homogeneous coordinates 
x % on P 4 , and H\,G\ are linear polynomials. One can take H\ to be the hyperplane section P. 
The quintic equation must be of the form P 3 (x l )P2{x l ) + H 1 (x z )Qa(x 1 ) + Gi(x 1 ')Ra(x' 1 ) = 0. Now 
P2{x l ) together with H\,G\ define a degree 2 rational curve C2, which touches C3 at 6 points. 
Indeed, there are 609250 degree 3 genus 1 curves in the quintic, the same as the number of degree 
2 genus curves. 
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bound on the chiral primaries takes the form Lq = J R + ^ p ■ In particular, since 
(Jr)i flows to (Jr)q , the chiral primaries are annihilated by (Jr)i , and flow to lowest 
SU(2)r weight states in the Ramond sector. For example, the AdS3 vacuum flows to a 
lowest weight state of spin J R = — ff- Together with the states obtained by acting with 
ip +± , this SU(2)r multiplet contributes to the modified elliptic genus with degeneracy 
2(jR ~ \) + 1 = \cr = D + ±c 2 ■ P (with the insertion of \F 2 in (|2T6D absorbed). This 
is precisely the Euler character of the moduli space of a "pure" D4-brane of charge p A , 
namely P D +T2 C2 ' P_1 . 

The prescription to compute the elliptic genus is 

Z(r,r, y )=Tr c ,. pr X-) F (^-24)^-^^ e27r ^ {3A) 

where Q' A = Qa + 3DabP B , and — 2J R ) is the contribution due to the SU(2)r 
multiplets described above. 

We propose to compute the first few terms in the elliptic genus using the dilute gas 
approximation in the AdS%. This involves a free gas of massless supergravity modes and 
wrapped M2 and anti-M2-branes. They can carry angular momenta on the S 2 as well as in 
the AdSs- In this approach, one can determine the fermion number of the chiral primaries 



corresponding to the wrapped M2-branes, as in [|T6[ , which is hard to determine by directly 
quantizing the classical moduli space of D4-branes. 

Let us denote by ■ the chiral primary operator dual to a graviton/hyper/vector 
multiplet of spin j on the S 2 , and Lq — L = n; and O^j {0~^) the chiral primaries dual 
to M2-brane (anti-M2-brane) carrying spin j and Lq — Lq = n.i The L_i descendants of 
the chiral primaries are dual to holomorphic derivatives of the corresponding operators. 
We have n= \ for the massless hypermultiplets, n = — 1, 0, 1, 2 for the graviton multiplet, 
and n = 0, 1 for the vector multiplets. And n = \ for an (anti-)M2-brane wrapped on 
a rational curve ||16|| . In the case of the quintic, the contribution to the elliptic genus 
from 204 hypermultiplets, 1 vector multiplet and 1 graviton multiplet is equivalent to 200 
hypermultiplets. 

In the following we redo the counting in the previous subsection using this dilute 
gas approximation (in the chiral ring language), which does not have the ambiguity with 
singularities of the classical moduli space of the D4-brane. 



6 It would be useful to justify the chiral ring generators and (lack of) relations directly from 
the sigma model description of the (0,4) CFT [23]. 
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• gi = 0, L = 1 

There are 200 0\ i's (counted with sign) that contribute, each giving rise to a 

2 ' 2 

fermionic Ramond state of spin jn = 2 — | = |. Hence the contribution to the (modified) 
elliptic genus is —4 x 200 = —800. This is the same answer as the one we obtained from 
the "naive" counting. 



• qi = 0, L = 2 

The states t 

of spin 1, i and | respectively. The counting is then 



The states that contribute are given by operators of the form 0\ ±0\ i; dO\ i; 0\ 



3 ) 

2'2 2'2 2'2 2'2 



3 • (^200 • 199) - 4 • 200 - 2 • 200 = 58500 
Note that this differs slightly from the answer 58900 we obtained from the "naive" counting. 
• qi = 0, L = 3 

The states that contribute are given by operators of the form 0\ xO\ l O\ i, 

2 ' 2 2 ' 2 2 ' 2 

Ol ^3, Ol 1 dO\ 1; Ol 5 , dOI 3, 9 2 0« 1; 0^\0~ C '\ The counting is 

2'2 2'2 2'2 2'2 2'2 2'2 2'2 2 ' 2 ' 

-2 • (200 • 199 • 198/6) + (3 + 1) • 200 • 200 - (4 + 2 + 0) • 200 + 2875 2 = 5797625 



-„ _i T _ 3 _|_ q _ 8 

• ?i - l,.Lo - 2 + TO - 5 

The operators that contribute are O^ 1 , which gives rise to —3 x 2875 = —8625 states, 

2 ^ 

the same as the naive counting in the previous section. 

• qi = 1,L = f 

The operators that contribute are Ol iOf\, O? 1 ,, <9£>f 1 . The counting is 

2 ' 2 2 ' 2 ' 2 ' 

2 • (-200) • (-2875) + (3 + 1) • (-2875) = 1138500 



. ?1 = 2,L = 2 + ^ = f 

The operators that contribute are O^ 2 ^. 

2 ' 2 

rise to —1218500 states. 
• Ql = 2, L = ^ 



The counting is the same as before, giving 
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The operators that contribute are 0\ ,0^, O c l\_, dO^^, 0^\0^\, (0 J 0- Cs ) h2 $ 

2 ' 2 2 ' 2 2'2 2'2 2' 1 2' 1 

The counting is then 

(-200) • (-609250) + (2 + 0) ■ (-609250) + 2875 • 2874/2 + 317206375 = 441969250. 

3. 3. Constraints from modularity 

Based on the general structure of the modified elliptic genus ( |2.9j ), we can write for 
M5-brane with charge p = 1 on the quintic X , 

4 

Z(T,T,y) = J2 Z k(q)®k(q,z) (3.2) 

fc=0 

where 

Q k (q y z) = Y^(-) n+k t 2Hn+ ^ )2 z 5n+k+ K z = e 2 ^ y . (3.3) 

n 

Using the results of our naive counting of BPS states based on the classical geometry of D4 
with fluxes, we can write the first few terms of the g-expansion of the functions (Zq, Zi, Z2), 

Zq (q) = q~ ™ (5 - 800q + 58900g 2 + 5755150g 3 + • • •) 

Zf(q) = Zf{q) = q-^ + i{8625q - 1150000g 2 + • ■ ■) (3.4) 
Zf(q) = Zf(q) =g-S + f(_i218500g 2 + 443196375g 3 + ---) 

Alternatively, counting gravitons and wrapped (anti-)M2-branes in A0IS3 in the dilute gas 
approximation gives 

Zo r - (?) = q~^ (5 - 800g + 58500g 2 + 5797625g 3 + • ■ ■) 

Z{- r \q) = Zl r \q) = g-S+f(8625g- 1138500g 2 + ---) (3.5) 
Z c 2 r \q) = Z^ r \q) = g"it+!(_i218500g 2 + 441969250g 3 + • ■ ■) 

Under SL(2, Z), the O^'s transform as 

(TO k )(q,z) = e-^i+^ 2 O k (q,z), 

(se k )(q,z) = Y,e-^ kl ^i(q,z) (3 ' 6) 

1=0 

7 Here O j is a kind of spectral flow operator that shifts Qa — ► Qa + 6DabP B (see also Q). 
In particular, it shifts the Lq value of 07 C3 by ^ 3 -,t, 5 ^ = — h, and hence the resulting 

_ } 2 ^ 

operator O j O^° 3 has Lq — Lq = 1. This operator is reminiscent of the state coming from the 
D4-brane with flux F = J — C3 in the previous subsection. 
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It follows that (Zq, Zi, Z2) form a modular representation, with T-transformation 

r = r 2 <| u 3 I (3.7) 



u 2 



and S'-transformation 




2 2 

5= -== I 1 w + w 4 w 2 + w 3 I (3.1 

IV 2 + UJ 3 UJ + UJ 4 

Knowing the T and S matrix, one can determine (Zo, Z±, Z2) solely from their polar terms 
by the generalized Rademacher expansion. In our case, however, it is possible to identify a 
basis of the exact modular forms, and hence determining (Zq, Zi, Z2) using any four of the 
coefficients in their g-expansions to fix the three functions completely. This would provide 
a highly nontrivial check on our "naive" counting of BPS states (|3.4|) , and the improved 

As explained in the Appendix, it is possible to construct three sets of modular vectors 
(Afc(r)), (Sfc(r)), (Cfc(r)), k = 0, • • • ,4, of weight 2, 4, 6 respectively, that transform under 
SL(2, Z) with the same T and S matrix as those of (Z k {r)) up to an overall phase, and 
have no polar terms. A basis for weight — | modular vectors in the same representation 
as Zk and with the appropriate polar terms is given by 

V~ 55 A k El V ~ 55 A k ElEl V ~ 55 A k El rr™B h E\E % , V ~ 55 B k E 4 El V ~ 55 C k El r,- 55 C k E 2 E 2 . 

(3.9) 

where E4 and Eq are Eisenstein series. This basis consists of modular forms that involve 
g - ft + To+l!> term in Z\ and g _ M + f , g~ff+§+ 1 terms in Z%, which are clearly absent by 
examining the allowed D-brane charges in the supersymmetric bound states. Taking these 
terms into account, we have 7 possible polar terms in (Zq, Z±, Z2), which exactly match 
the basis of 7 modular vectors (|3.9|) . 

It turns out that ( |3.4j) almost fits in the g-expansion of the exact modular forms, 
but has about 1% error in some of the coefficients. It seems clear that the numbers 
5, -800, 8625 = 3 x 2875 and -1218500 = -2 x 609250 are obtained in unambiguous ways, 
whereas in counting the other coefficients in ( |3.4| ) we ignored the subtlety when the D0- 
branes coincide etc. By fitting the former four numbers with the basis (|3.9| ), we find the 
exact modular vectors 

Z (q) = q~™ (5 - 800q + 58500g 2 + 5817125g 3 + 75474060100? 4 + 28096675153255g 5 • ■ •) 

Z x (q) = Q"it + ^(8625g5 - 1138500g§ + 3777474000g 7/2 + 3102750380125g 9/2 • ■ •) 

Z 2 (q) = q"^ + ^(-1218500q 2 + 441969250q 3 + 953712511250^ + 217571250023750g 5 • • •) 

(3.10) 
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This is surprisingly close to ( |3.4| ) obtained by the "naive" counting of D4-D2-D0 bound 
states. Even more surprisingly, the first three coefficients in Zo(q) and the first two coeffi- 
cients in Zi(q), Z%{<i) exactly match the answer obtained from the dilute gas approximation 
in AdSs ( |3.5| ) ! One may also view this result as an exact "prediction" of the Gromov-Witten 
invariants of genus 0, degree 2 and 3, from the modular invariance of the modified elliptic 
genus. 

Note that the fourth term in the (/-expansion of ZQ V -(q) in ( |3.5| ) differ slightly from the 
one in ( p.lOj) . This mismatch might be due to corrections to the dilute gas approximation, 
or equivalently, the chiral ring relations we have assumed. It would be nice to understand 
this precisely. 

We conjecture that (|3.10| ) gives the exact modified elliptic genus of the M5-brane CFT 



on the quintic with p = 1. In closed form, using the modular forms defined in the appendix, 
we can write (equivalent to ( |3.1U| )) 

Z(t, t, y) = — ^ [(20£f + 24500£f A - 10703200A 2 )P (r, r, y) 

+ (-225Pf + 167375^1 A) Pi (r, r,y) + (125Ej - 89875P 4 A) P 2 (r, T,y)] 

where A = t? 24 , rj, E4, Eq are understood to be functions of r. 



4. The Z5 quotient 

Now let us consider a different example, with the Calabi-Yau X being the Fermat 
quintic Y^i=\ x i = modded out by the freely acting symmetry Z5, generated by Xi 1— > u l Xi 
where u = e 2ni / 5 . This CY space has intersection form 6 Dm = 1 instead of 5 for the 
quintic. We shall consider the M5-brane wrapped on the 4-cycle of charge p = 1 and p = 2 
respectively. 

4.1. p = l 

A p = 1 divisor Pi C X takes the form x % = 0. Unlike the case of quintic, now Pi 
is rigid, and there are five of them. x{P) = H? J • J — 1- There is only one term in the 
expression ( |2.9[ ) for the modified elliptic genus Z(r, r, y). In fact, it is completely fixed by 
its modular weight (— |, |) and its polar term 5q~^, 

Z 1 (t,t, y) = 5r ? (r)- 11 P 4 (r)^i(r, y). (4.1) 
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Note that E 4 (r) is also the theta function of the E$ root lattice r 8 . This result admits a 
very simple explanation. The factor r? -11 comes from the partition function of DO pointlike 
instantons on Pi, which counts the Euler character of the Hilbert scheme of points on Pi. 
Ea{t) — Or 8 (r) counts the various way of dissolving DO-branes into fluxes F e H 2 (Pi, Z) 
such that F ■ J = 0. In fact, we have the decomposition 

H 2 (P U Z) = {a-(a- J)J}®ZJ (4.2) 

The anti-self-dual part of the lattice is even, hence must be — r 8 . 

4.2. p = 2 

In this case, the degree 2 divisor P 2 can be defined by polynomial of the form ax\x 4 + 
bx2X3 + cx\ = and four other similar quadratic polynomials. x{Pi) = 28, J • J = 2. 
There is no Freed- Witten anomaly in this case. We can write the modified elliptic genus 
in the form 

Z 2 (r,r,y) = Z (r)e 3 (2r,y) + Z 1 (r)e 2 (2r,y) (4.3) 

where Zq(t) = q~^(ao + a\q + •••), Z\{j) = (5 + h\q + •••). ao, ai, bo are the 

only polar coefficients. It is again possible to write a basis for the exact modular vectors. 
Although, we have not been able to count higher coefficients directly from the classical 
moduli space of the D4-D2-D0 bound states, and hence cannot check them against the 
constraints from the modular invariance of Z 2 (r, r, y) . 

5. Conclusion 

We see from the very basic example, the p = 1 M5-brane on the quintic, that modular 
invariance imposes powerful constraints on the degeneracy of BPS states, which encodes 
highly nontrivial relations of enumerative geometric invariants. In fact, the coefficients 
of the M5-brane elliptic genus can be thought of a class of new geometric invariants, 
which generalizes Gromov- Witten invariants. The M5-brane elliptic genus also gives a 
natural way of associating modular forms with (M-theory) attractor Calabi-Yau threefolds, 
which might or not have interesting connections to the modularity of arithmetic algebraic 
varieties. 

Let us list a few problems to be studied subsequently: 
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• Going beyond the dilute gas approximation in counting chiral primary states in Ad S3 x 
S 2 x X. In particular, it would be nice to understand the chiral ring relations, say from 
the sigma model description of the (0, 4) CFT. 

• To understand the singularities in the classical moduli space of D4-brane with fluxes, 
and their contributions to the BPS D4-D2-D0 bound states. This would allow a general 
definition of the relevant enumerative geometric invariants. 

• Extending our counting of BPS states to M5-branes of higher degrees, i.e. p > 1, on the 
quintic; as well as to other Calabi-Yau manifolds. In particular, it would be nice to count 
the BPS states on the Z 5 quotient of the Fermat quintic and compare to the modular 
property of the p = 2 elliptic genus. We expect the fragmentation of the BPS states to 
play a role here. 
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Appendix A. A basis of modular vectors 

In this appendix we will construct explicitly a basis of modular vector of weight — | 
in the same representation of Zk(r) (appearing in the elliptic genus of M5-branes wrapped 
on the hyperplane section in the quintic) and of the same polar terms. Alternatively, we 
can construct a basis for the modular form Z{r,r,y) directly. Let us start with the theta 
functions relevant for the right-moving sector of the p = 1 elliptic genus for the quintic are 




(A.l) 



nez 



where q = e 2? ™ T , z = e 27Ziy . 

^From unitarity of the S and T matrices, it follows that 



4 




(A.2) 



transforms as a weak Jacobi form of weight (|, |). 
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Specializing ( |A.2| ) to s = ?, s = 2 -£i, s = ~ gives rise to three basic functions, 

4 

5 2 (r, 7, y) = e 5 ^ 4 ^ 6 fc (r, £)9 fc (r, y) 



A;=0 
4 



5 3 (r, r, y) = ze 5 ^/ 4 £ 9 fc (r, ^)G fc (r, y) (A.3) 



fc=0 

4 



They transform under S and T as 

S A ^S 2 AS 3 (A.4) 

whereas S4 and S3 transform to themselves under T and S, respectively. (£2, S3, S4) 
transform in exactly the same way as the Jacobi theta functions (62, #3, O4), which are also 
the specialization of the weak Jacobi form #i(r, s) at s = |, s = ^-j 1 -, s = 5, multiplied by 



prefactors similar to the ones in (|A.3|) . 

Hence GSO projection can be used to make modular invariant expressions. In partic- 
ular, 

4 

P n (r,r,y) = J2W 8n+3 Si(r,r,y) (A.5) 

is a weak Jacobi form, of weight {An + 2, |). 

The space of all possible weak Jacobi forms of the form 

4 

Y,Z k {r)Q k {r,z) (A.6) 

with the appropriate polar terms for as described in section 3 is a module with coeffi- 
cients being holomorphic modular forms. The three simplest expressions Pq,Pi,P2 are a 
basis for this module. 

A complete set of possible Jacobi forms in this module with a q expansion starting at 
q~ii and of weight (— |, V) is 

£ 4 (t) 6 P £ 4 (t) 3 P Pq E 4 {t) 5 P 1 £ 4 (t) 2 P £ 4 (t) 4 P 2 E 4 {t)P 2 
n{r) 55 ' ?y(r) 31 '^(r) 7 ' ?y(r) 55 ' ?y(r) 31 ' ?y(r) 55 ' 77(t) 31 [ ' 
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It is convenient to write a basis for the 5-dimensional modular vector Z^{r\ instead 
of the function ( |A.6| ). This basis can be extracted from ( |A.7|) . Alternatively (and equiva- 
lently), one can directly construct three holomorphic modular vectors, Ak(r), Bk(r) and 
Cfc(r), which transform in the same modular representation as -Zfc(r), but have weight 2, 
4 and 6. One can start by defining 

4 

i=2 
4 

B (r) = J20 l (r) 7 e i (5r), (A.8) 



i=2 
4 

i=2 



The rest of Ak, -Bfc, Cfc (k = 1, • ■ ■ , 4) can be obtained by modular transforms of (|A.8| ). One 
can check that the resulting functions indeed form 5-dimensional modular representations, 
which may not be immediately obvious by this construction. Knowing A^, B^, one can 
then multiply them by ?7(r) -55 times weight 24,22,20 holomorphic forms respectively, to 
obtain a basis for Zfc(r), as shown in section 3.3. 
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